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ABSTRACT 

Searches for radio pulsars are becoming increasingly difficult because of a rise in im- 
pulsive man-made terrestrial radio- frequency interference. Here we present a new tech- 
nique, zero-DM filtering, which can significantly reduce the effects of such signals in 
pulsar search data. The technique has already been applied to a small portion of the 
data from the Parkes multi-beam pulsar survey, resulting in the discovery of four new 
pulsars, so illustrating its efficacy. 
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1 INTRODUCTION 

Pulsar search data are often corrupted by the presence of im- 
pulsive, broadband and sometimes periodic terrestrial radi- 
ation. Such radio frequency interference (RFI) originates in 
unshielded electrical equipment which produces discharges, 
such as automobile ignition systems, electric motors, and 
fluorescent lighting, as well as discharge from high-voltage 
power transmission lines. It may also arise naturally from 
the radio emission generated in lightning discharges. Such 
RFI can often be very strong and can even enter receiver 
systems through the far-out sidelobes of the telescope recep- 
tion pattern. Several methods have been employed to reduce 
the effects of RFI, such as clipping intense spikes, removing 
parts of the fluctuation spectrum, and identifying common 
signals in the different beams of a multi-beam receiver sys- 
tem. These procedures all require carefully tuned algorithms 
to remove the interference, and at the same time must cause 
minimal damage to the astronomical data. 

RFI signals are mostly broadband but generally do not 
display the dispersed signature of radio pulsars. Here, we 
present a simple algorithm which we call 'zero-DM filtering' 
to selectively remove broadband undispersed signals from 
data prior to the application of normal pulsar search algo- 
rithms. The outline of this paper is as follows: following the 
description of the algorithm in section 2, in section 3 we 
show that the procedure does indeed remove much of the 
interference in typical observing situations and in general 
greatly improves the visibility of celestial dispersed pulses. 
In section 4 we present four new pulsars discovered in the 
Parkes multi-beam pulsar survey (PMPS) after applying the 
new technique. Finally section 5 is a discussion of the ben- 
efits and limitations of the procedure. 



2 ZERO-DM FILTERING 

A fundamental characteristic of broadband pulsar signals 
is the frequency-dependent dispersion of their pulse arrival 
times as a result of traversing the ionised component of the 
interstellar medium. Pulses observed at lower frequency ar- 
rive later than their higher- frequency counterparts. The de- 
lay, t, at radio frequency / (MHz) is given by: 



t = 415o(™) sec, 



(1) 



where DM is the dispersion measure, the integrated column 
density of free electrons along the line of sight, measured in 
cm _3 pc (e.g. Lyne & Smith 2006). Detecting a pulse with a 
finite bandwidth receiver results in a broadened pulse profile 
and a corresponding reduction in pulse signal-to-noise ratio. 
Before any search for pulses can be performed, the data 
have to be compensated for the effects of a number of trial 
values of DM. In order to do this, the bandwidth of the 
receiver is first split into a number of independent frequency 
channels, which are appropriately sampled to produce a two- 
dimensional array of samples, S(/i,£j) at frequency fi and 
time ij. Appropriate time delays for a given trial DM are 
then applied to each frequency channel so that any pulses at 
this DM are aligned in time. The frequency channels are then 
summed together to produce a time series of dedispersed 
data, x(t). 

The zero-DM filter is implemented prior to the dedis- 
persion described above, by simply calculating the mean of 
all frequency channels in each time sample and subtracting 
this from each individual frequency channel in the time sam- 
ple. Hence the adjusted values of the samples, S'(/i,tj) are 
calculated as: 
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alised box-car pulses of varying width for the PMPS observing 
system. The time scale should be multiplied by the DM in cm - 3 pc 
to give the time in milliseconds. 



Figure 1. The effect of the the zero-DM filter on an idealised nar- 
row linearly-dispersed pulse in the frequency-time domain. The 
top panel (a) shows the dispersion drift of the pulse B dt/df over 
the full bandwidth B of the receiver. Subtraction of the mean in 
vertical strips to remove zero-DM signals (Equation leaves the 
non-pulse area (shaded grey) negative. Panel (b) shows the re- 
sult of dedispersing the data at the correct value of DM and the 
lower panel (c) shows the resultant pulse shape after adding all 
the frequency channels together. 
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Clearly, any broadband undispersed signal will result in 
a simultaneous rise across all frequency channels and will be 
removed by this process. We now investigate the effect of this 
procedure on dispersed cosmic pulses. Consider an idealised 
dispersed pulsar signal with very narrow pulses and approx- 
imate the dispersion drift across the full receiver bandwidth 
B to a linear slope, dt/df, which is given approximately by: 



1L = _ 8300 (™) sec/MHz, 



(3) 



where fo (MHz) is the central observing frequency. Figure [TJi 
shows such a pulse sweeping through the frequency band of a 
receiver, traversing the full bandwidth in a time of B dt/df. 
After subtraction of the mean in vertical strips as described 
by Equation [2] the non-pulse grey area in the Figure [TJi 
is negative. Dedispersion then distorts this pattern in the 
manner shown in Figure [TJ), so that adding vertically after 
the dedispersion then gives the convolving function, w(t) 
shown in Figure QJ;. Note the negative triangular area which 
is adjacent to, and equals the area of, the pulse. Thus the 
zero-DM process results in the dedispersed time series x(t) 
being convolved by this function, w(t). Of course any real 
celestial pulse will have a finite width. In Figure [2] we show 
the effects of the zero-DM filter on idealised box-car pulses 
of different widths for the PMPS observing system at 1.4 
GHz (Manchester et al. 2001). In this case, f = 1394 MHz 
and B=288 MHz. The pulse width in milliseconds can be 
calculated by simply multiplying by the DM in cm _3 pc. For 
example, at a DM of 100 cm _3 pc the bottom pulse would 
have a width of 46 ms. The peak amplitude clearly decreases 
for pulses with larger widths. 



Frequency (Hz) 

Figure 3. Two example effective zero-DM filters for 
DM=500 cm- 3 pc and DM=100 cm- 3 pc for the PMPS, 
showing variation in relative spectral amplitude with the 
fluctuation frequency. 



In the frequency domain, equivalent ly, the fluctuation 
spectrum of the dedispersed times series is multiplied by the 
Fourier transform, W(u), of w(t) which can be shown to be 
of the form: 



W(v) = 1 -sinc 2 (7rB^zy) 
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where v is the fluctuation frequency of the signal. Figure [3] 
shows the effect of the zero-DM filter on the spectral am- 
plitude of a pulse at two specified DM's for PMPS-style ob- 
servations. The zero-DM process effectively acts as a high- 
pass filter on the dispersed pulse. The 'low- frequency cutoff', 
^cutoff can be shown using Equation [4] to lie at a fluctuation 
frequency -500/DM Hz. Thus for DM=100 cm" 3 pc, all fre- 
quencies <5 Hz will be lost. The reduction in amplitude and 
pulse distortion we see in Figure [2] can be explained by the 
loss of the low frequency components of the pulse profile. 

For a typical pulsar we measure a regular train of nar- 
row pulses, the spectrum of which is a 'picket fence.' The 
zero-DM filter will cut off all spectral features below ^cutoff- 
However, normal pulsars with pulse widths a few percent of 
their pulse period will usually have most of their power in 



spectral harmonics at higher frequencies and these will not 
be affected significantly. Since standard pulsar searches per- 
form harmonic summing (see e.g. Lyne & Smith 2006 or, for 
a detailed description of pulsar search algorithms, Lorimer 
& Kramer 2005), the detrimental effect of the zero-DM fil- 
ter on the final spectral amplitude is reduced. Assuming the 
pulsar has n ~ P/2W harmonics of equal amplitude where 
P is the pulsar period and W is the pulse width, the num- 
ber of harmonics lost below the low- frequency cutoff is given 
by ricutoff ~ ^cutoff, the harmonic summing procedure will 
increase the spectral signal-to-noise ratio by a factor of ap- 
proximately (n - n cu toff) 1/2 - 

The zero-DM process causes a predictable reduction in 
the amplitudes of low frequencies of the fluctuation spec- 
trum of a dispersed pulsar. It will also reduce the ampli- 
tude of any broadband undispersed impulsive signals sub- 
stantially, but will have little effect upon thermal noise. The 
signal- to- noise ratio of the pulsar can therefore be optimised 
by applying an optimum matched filter to the spectrum, 
which reduces the spectral amplitude where the pulsar sig- 
nal is known to be small because of the zero-DM filtering. 
Thus, there is a second step to the filtering process whereby 
the frequency response of the zero-DM filter is re-applied 
after each dedispersion trial. In the time domain this is best 
illustrated by considering a single-pulse search (McLaugh- 
lin et al. 2006). Standard single-pulse searches involve con- 
volution of the dedispersed time series x(t) with box-cars 
b(i) of various widths and searching for peaks in x(t) * fr(t), 
where * denotes convolution. In our case, the zero-DM fil- 
tered time series is x' (t) = x(t) * w(t), so that a standard 
single-pulse search looks for peaks in x' (t) *6(£). As a result 
of zero-DM filtering the optimal filter is now not a box-car 
but rather is given by b' (t) — b(i) * w(t). We now search 
for peaks in x" (t) = x\t) * b'(t) = F~ l [X' (v) * W(y)] * b(t) 
where T denotes the Fourier transformation and we have 
used the commutability of convolution so the convolution 
can be performed in the frequency domain, which is what is 
done practice. 



3 EXAMPLES 

The effects of the zero-DM filter have been investigated 
using simulated PMPS data generated with the Sigproc- 
4qj pulsar analysis software suite. Figure |4Jl shows sim- 
ulated data of a 130-ms burst of broadband RFI with 
DM=0 cm _3 pc followed by a 20-ms dispersed pulse with 
DM=150 cm _3 pc across a 288MHz bandpass centered at 
1374 MHz. Figure [Dd shows the same data after application 
of the zero-DM filter. The broadband RFI signal has been 
completely removed with little effect on the dispersed pulse. 
Dedispersion at a DM=150 cm _3 pc and summation in fre- 
quency produces the pulse profile shown in Figure |4j:. The 
expected pulse distortion is clearly visible. 

We also present examples of the zero-DM filter as ap- 
plied to observational data from the PMPS in both peri- 
odicity and single-pulse searches. All clipping and zapping 
algorithms used previously for mitigating the effects of RFI 
(Hobbs et al. 2004) have been omitted. In our periodicity 
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Figure 4. The top panel (a) shows a grey plot of simulated data 
of a 130-ms burst of broadband RFI with DM=0 cm 
lowed by a 20-ms dispersed pulse with DM=150 cm -3 
288MHz bandpass centered at 1374 MHz. The middle panel (b) 
shows the same data after application of the zero-DM filter. Note 
the negative non-pulse area. In panel (c), the data have been 
dedispersed for a DM=150 cm _3 pc and summed in frequency 
giving the pulse profile. 



search examples re-application of the zero-DM filter after 
each dispersion trial has not been performed because of the 
additional computational overheads this would impose in 
our search algorithms (see Section 5 for a further discussion 
on this subject). 

Figure [5] illustrates clearly the effects of the proce- 
dure on a 35-minute PMPS observation in the direction of 
PSR J1842+0257, which has a period of 3.1 seconds and 
a DM of 148 cm _3 pc, so that the zero-DM low-frequency 
cutoff is at about 3.3 Hz. On the left is the normal search 
output, while on the right is that with the zero-DM filtering 
procedure in place. After application of the zero-DM filter 
the red noise and impulsive interference is almost completely 
removed, and the expected pulse distortion due to the filter- 
ing as shown in Figure [T]: and Figure 2t is clear. Remarkably, 
even with such a long-period pulsar, in which the funda- 
mental and first few harmonics are completely missing, the 
absence of the interference makes its detection more secure 
than previously. A number of periodicity searches on PMPS 
beams containing known pulsars with a range of periods and 
dispersion measures has been performed. The fluctuation 
spectra from the periodicity search are much cleaner than 
before (see Figure [6}. The 'forest' of RFI signals at low fre- 
quency are completely removed by the new technique. The 
pulsar spectral signal-to-noise ratios behave as expected, but 
because of the reduction in the number of periodic RFI sig- 
nals, the pulsars are easier to detect. 

Figure [3 shows examples of single-pulse search diagnos- 
tic plots from our analysis of the PMPS. Plotted in Figure 
are the time series for each of the 325 trial DM's (in the 
range — 2200 cm _3 pc). Each detected single-pulse event is 
plotted as a circle with radius proportional to signal-to-noise 
ratio. The top panel is the result of a standard analysis with- 
out zero-DM filtering. The observation contains single pulses 




Figure 5. The effects of the zero-DM filter on folding PMPS 
data from the 3.1-second pulsar, PSR J1842+0257, which has a 
DM of 148 cm _3 pc. The left-hand panels are the result of using a 
regular analysis, while the right-hand panels are after application 
of the zero-DM filter. On each side, at the top are grey plots of 
63 temporal sub-integrations folded at the pulse period, cover- 
ing the full 35-minute survey observation, and at the bottom is a 
panel showing the full integrated profile. The effect of the filter 
on the shape of the pulse profile can be clearly seen. The asym- 
metry of the depressions either side of the pulse arise because 
the dispersion sweep across the bandpass is not perfectly linear 
but has a quadratic component, although in most cases the sweep 
is well approximated by a linear slope. Note that the impulsive 
RFI present through the majority of the observation is almost 
completely removed and the baseline wobble in the final profile is 
much flatter in the filtered case. 
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Figure 7. Single-pulse search diagnostic plots of a 35-minute ob- 
servation of the erratic pulsar PSR B1735— 32. Top: using stan- 
dard search method without zero-DM filter; Broadband terrestrial 
interference causes the large stripes across a wide range of DM. 
Middle: After using zero-DM filter, most RFI streaks have been 
removed with single pulses from the pulsar now much more visible 
(at DM channel~82). Bottom: After using the filter and apply- 
ing the optimal matched filter. Remnant RFI streaks are further 
removed and pulses from the pulsar remain. 




Figure 6. Fluctuation spectra from a PMPS survey observation 
in the direction of the 0.53-second pulsar, PSR J1604-4718, which 
has a DM of 52 cm _3 pc. The top panel shows the spectrum with- 
out any zero-DM filtering, the bottom panel is the same data after 
the zero-DM filter has been applied. The arrows indicate the po- 
sition of the fundamental spin frequency of the pulsar and four 
subsequent harmonics. Most of the RFI signals are completely 
removed by the new technique. 



from PSR B1735-32 at DM channel=82 (DM=50 cm" 3 pc), 
but we can see that the output is contaminated with many 
RFI streaks making identification of the pulsar difficult. The 
middle panel shows the corresponding plot with zero-DM 
filtering applied. The vast majority of the RFI has been re- 
moved but the pulsar is still present. Obvious also are a few 
remnant RFI streaks at high DM which have not been re- 
moved by the filtering. Searching the time series with the 
optimal single-pulse profile, w(t), improves things even fur- 
ther by removing the remnant streaks almost completely, as 
can be seen in the lower panel. 



4 DISCOVERY OF FOUR NEW SOURCES 

The zero-DM filter has been incorporated into a new re- 
analysis of the PMPS using acceleration searches (Eatough 
et al. in prep) . So far three new pulsars have been discovered 
(see Table 1 & Figure [8}. Figure [8] shows folded subintegra- 
tions and integrated pulse profiles for each of the pulsars in 
both a standard analysis and after using the zero-DM filter. 
In all cases impulsive RFI has been removed. Although this 
demonstrates an improvement in the quality of the folded 



Table 1. Preliminary properties of the 4 new sources discovered 
in our re-analyses of the PMPS. The nominal positions quoted 
are the positions of the centre of the beam in which the source 
was discovered and have errors of less than 7 arcmin, the radius 
of the PMPS beam (Manchester et al. 2001). 



J1 539-4835 (zero-DM filtered) 



Name 


ol (J2000) 


S (J2000) 


Period(s) 


DM(cm _3 pc) 


J1724-3549 


17:24:43.0 


-35:49:18.6 


1.4085 


550.0 


J1539-4835 


15:39:18.7 


-48:35:14.0 


1.2729 


136.3 


J1819-1711 


18:19:50.3 


-17:11:48.0 


0.3935 


400.8 


J1835-0115 


18:35:13.9 


-01:15:17.0 


0.0051 


98.1 



data, the discovery of these sources was primarily aided by 
either a reduction of RFI features in the fluctuation spec- 
tra or because wide spectral niters have not been applied 
around strong periodic sources of RFI. Of particular interest 
is PSR J1835— 0115, a 5.1- millisecond pulsar in a 6-day or- 
bit around a low mass companion. All three pulsars are now 
being timed using radio telescopes at either Jodrell Bank or 
Parkes. 

In addition the zero-DM filter is being applied to our 
re-analysis of the PMPS using single-pulse searches (Keane 
et al. in prep). Here we present one new source (see Table 
1). This source, which has a period of 1.4s, shows single- 
pulse diagnostic plots which indicate a strong resemblance 
to the newly- discovered class of Rotating RAdio Transients 
(RRATs) (McLaughlin et al. 2006). Interestingly, this object 
shows pulses from two parts of the pulse rotation period, sep- 
arated by about 0.2 sec. We are continuing to monitor this 
source using the Parkes radio telescope to further constrain 
the spin period and to obtain a period derivative so it can 
be compared to the values of period derivative measured for 
the other RRATs. 



5 DISCUSSION 

Zero-DM filtering reduces the number of spurious candidates 
detected by pulsar search software - both in standard peri- 
odicity searches and in single-pulse searches. A major ad- 
vantage of zero-DM filtering is that it eliminates the need 
to apply arbitrary cleaning techniques to pulsar search data. 
One commonly-used technique is that of clipping the multi- 
channel data based upon spikes in the DM=0 time series 
(e.g. Hobbs et al 2004). For 1-bit sampled filterbank data 
like that in the PMPS, with n channels, the time samples 
should have a mean of n/2 and a standard deviation of y/n/2 
(e.g. Lorimer & Kramer 2005). Typical clipping algorithms 
set each of the n channels to alternate zeros and ones if 
the time sample differs from the mean by more than three 
standard deviations. Clipping could pose a threat to intense 
burst- like dispersed signals that are strong enough to be de- 
tected in the low-DM trials of a pulsar search. It is precisely 
these type of transient events which may reveal exciting new 
astrophysical phenomena (Lorimer et al. 2007). Since zero- 
DM filtering relies on the undispersed nature of RFI, rather 
than its sheer strength, such signals will not be removed. 

The primary RFI excision technique for pulsar period- 
icity searches up until now has been frequency domain 'zap- 
ping'. This method requires the identification of common 
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Figure 8. Folded subintegrations and integrated pulse profiles 
for three of the pulsars discovered. For each pulsar we show the 
standard analysis on the left and the zero-DM filtered data on 
the right. 



signals in the fluctuation spectra from independent obser- 
vations at different positions on the sky. Such signals likely 
have a local terrestrial origin and enter the receiver system 
through the far-out sidelobes of the telescope beam. Once 
the RFI signals have been identified their harmonic sequence 
is removed from the fluctuation spectrum. Typical spectral 
zapping routines can remove a few percent of the fluctua- 
tion spectrum giving a small chance that a coincident pulsar 
frequency or its harmonics could be removed. The zero-DM 
filtering process presents a more natural way of removing 
such RFI signals without the dangers inherent to zapping. 

Although effective at removing RFI in our analyses of 
the PMPS, we now note a number of limitations and practi- 
calities of the zero-DM filter. Firstly the technique will not 
benefit high-frequency, or small bandwidth pulsar searches 
because in this case even signals from celestial sources will 
not be highly dispersed. For example, the dispersive de- 
lay across the entire 576-MHz bandwidth in the Parkes 
methanol multi-beam pulsar survey at 6.3 GHz is less than 
2 ms for a source with DM=100 cm _3 pc (e.g. O'Brien et 
al. 2008.). In this case the zero-DM filter would have a low- 
frequency cutoff around 230 Hz making detection of all but 
millisecond pulsars impossible. 

In single-pulse searches, impulsive RFI signals can oc- 
casionally be strong enough to persist even after zero-DM 
filtering. The remnant RFI streaks appear as high signal-to- 
noise features at non-zero DM. However such remnant RFI 
streaks will not have the expected drop off in signal-to-noise 
ratio as a function of trial DM, nor will they appear dis- 
persed according to Equation [T] like a true celestial source. 
They are also likely to appear in multiple beams of a multi- 



beam receiver. Each of these additional properties can be 
used to identify such spurious signals. 

An assumption made in the analysis of the implemen- 
tation of the zero-DM filter is that of a linear dispersion 
slope when the true slope is in fact quadratic. A complete 
description of the dispersion slope increases the difficulty 
of implementing the algorithm, with little benefit. The ef- 
fects of this assumption manifest themselves in phase-folded 
pulse profiles which have asymmetric dips as shown in Fig- 
ure [5] for PSR J1842+0257, unlike the symmetric dips we 
have considered in Figure [1] 

Future pulsar surveys will be performed with higher 
time and frequency resolution^]- Fast dedispersion codes are 
being developed to cope with the large volume of data that 
will be produced (Bailes, private communication). These 
dedispersion algorithms operate on 1-bit or 2-bit data before 
the samples have been unpacked as floating point numbers. 
In these algorithms, calculation of the mean and subsequent 
subtraction from each frequency channel sample as in Equa- 
tion [2] may not be possible at the pre-dedispersion stage. 

The factor of two increase in the number of compu- 
tations imposed by re-application of the zero-DM filter af- 
ter every dispersion trial might not be practical in searches 
where large numbers of Fast Fourier Transformations are 
performed, viz. searches for highly accelerated binary pul- 
sars (e.g. Eatough et al. in prep). Another practical consid- 
eration is for data sampled with a larger number of bits, 
i.e. a large dynamic range. In this scenario any RFI with 
intensity structure across the band may 'leak' through the 
zero-DM filter. 

We have implemented the zero-DM filter in the Sigproc- 
4-2 pulsar analysis software suite and are currently applying 
the process in a re-analysis of the PMPS in both acceleration 
searches (Eatough et al. in prep) and single-pulse searches 
(Keane et al. in prep). 
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